AN EXPLICIT FORMULA FOR THE ARITHMETIC 
GEOMETRIC MEAN IN GENUS 3 



D. LEHAVI AND C. RITZENTHALER 

Abstract. The arithmetic geometric mean algorithm for calculation of 
elliptic integrals of the first type was introduced by Gauss. The analog 
algorithm for Abelian integrals of genus 2 was introduced by Richelot 
(1837) and Humbert (1901). We present the analogous algorithm for 
Abelian integrals of genus 3. 



1. Introduction 

1.1. The Arithmetic Geometric Mean (AGM) was discovered by Lagrange in 
1785 and independently by Gauss in 1791. It is described as follows: given 
two positive numbers a and b, define M(a, b) as the limit of the following 
convergent sequences: 

ao := a, bo = b 

During the period 1791-1799 Gauss discovered a relation between the AGM 
and elliptic curves: 

1.2. Theorem (Gauss, see |Cox| . |BM] 1 . For each pair of positive real num- 
bers in the AGM double sequence On > bn > define: 

._^/2|l2\ ._ _ t2 ._ _2 

Gnl ■ — 3^*^" n)i ^n2 • — "ni ^n'i • — 6^1 

Denote by En the elliptic curve given by the equation 

yl = 4:{xn - e„i)(x„ - e„2)(a;n - Cns), 
then the following sequence of Abelian groups: 

dxn + 1 

Vn Mn + l 

^ {0, (e„i, 0) -^}^En > En+i ^ 

is exact for all n. 
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1.3. It is easy to see that we create in this way a sequence of 2-isogenous 
elhptic curves. Gauss generahzed the definition of the AGM to the complex 
numbers; in this case there is a choice involved when taking the square root. 
Gauss described the resulting correspondence, see |(^oxj for the description. 
Recall that the real points in the Picard group of a curve which is defined 
over M are the divisor classes which are invariant under the action of the 
group Gal(C/M) (see [(xHj sections 1-5). Gauss proved that if the 2-torsion 
points of Pic(£') are real then there is a unique a £ Pic(£')[2] such that the 
2-torsion points of Pic(-E^)[2] are real. Applying this property iteratively, 
one gets an algorithm for calculating elliptic integrals (see |Goxj . [BM] ) of 
the form: 

dx 

Je3 a/(x - ei){x - e2){x - 63) 

This iterative algorithm is applied in numeric evaluations of certain types 
of Abelian integrals (see |BBj ) . 

In genera higher than 1 one can hope for an isogeny between the Jacobians 
of the curves. Before stating results in higher genera, we recall some facts 
on polarized Abelian varieties. 

1.4. A pair {A, Q) where A is an Abelian variety and is a divisor of A is 
called a polarized Abelian variety. The divisor Q is called the theta divisor 
of the polarized Abelian variety and the map A — > Pic°(A) defined by 
a ^ Tg7^(0) — is called the polarization of the pair (A, Q). Since the kernel 
of the polarization is a finite Abelian group whose rank is bounded by twice 
the genus of A we describe its isomorphism type by 2 copies of a monotonic 
sequence of genus (^) natural numbers. We will abuse of notations and 
denote for instance the sequence (2, 2, 2, 2, 1, 1), (2, 2, 2, 2, 1, 1) by 2'^1^. If 
the polarization type is trivial we say that the polarization is principal; in 
this case we say that ^4 is a principally polarized Abelian or PPAV. The 
translates of G which contain are called the theta characteristics of A. 
The theta characteristics are called even or odd if their multiplicity at 
is even or odd. The theta characteristics of an Abelian variety A induce 
a symplectic structure on the F2-vector space A[2] (the group of 2-torsion 
points in A) in the following way: Let ^ be a theta characteristic of A, then 
the map 

q ■■ A[2] ¥2 

a^h°{e + a) + h°{a) mod 2 

is a quadratic form over F2. The quadratic form q induces the following 
symplectic pairing on the group A[2]: 

{a, b) = q{a + b) — q{a) — q{b) mod 2. 

This pairing is called the Weil pairing. If G is a subgroup of A[2] we will 
use the notation 



:= {a G A[2]\{a,g) = for all g € G}. 
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If A is a PPAV and G is a subgroup of the group A[2], then Pic (A/G) is 
naturahy isomorphic to I'ic^{A)/G^. Whence the AbeUan variety A/G is 
principally polarized only if G is 0,A[2], or a maximal isotropic group of 
A[2] with respect to the Weil pairing. Finally recall that a Jacobian of a 
smooth curve C is principally polarized by the theta divisor Qq - the image 
of Sym^~^G in Jac(C') under the Abel map. 

1.5. The dimension of the moduli space of principally polarized Abelian 
varieties of genus g is g{g + l)/2, while the dimension of the moduli space 
of curves of genus g > 2 is 3g — 3. Thus if C is a generic curve of genus 
g < 3 and L is a maximal isotropic subgroup of Jac(C')[2] then Jac(C')/L is 
a Jacobian of some curve C' . This motivates the following questions: 

• Is this an algebraic correspondence ? 

• Does there exist a curve C' for every pair C, L in genera 2, 3 (and 
not only generically)? 

• If C is a real curve, are there "distinguished" maximal subgroups ? 

• What is the situation for genera higher then 3 ? 

In the case g = 2 the first three questions were settled by Richelot (see |Ricj ) 
and Humbert (see |IlTimj ) . Both Richelot & Humbert described an iterative 
algorithm for curves of genus 2 with 6 real Weierstrass points, Richelot 
described algebraically the curve G' in terms of the curve G and Humbert 
described the isomorphism 

H\G,Kc)^ H\C',Kc>). 

See |DLj section 4 for a modern review of the construction and |BMj for 
the resulting integration identities and the iterative integration algorithm 
resulting in the real case. Using modern tools (namely GAGA), the answer 
to the first question is immediately positive in all genera. Donagi & Livne 
solved the second question for genus g = 3^ and answered negatively the last 
question: 

1.6. Theorem (Donagi & Livne, see |DLj l. Let G he a smooth curve of genus 
g over a base field of characteristic different from 2,3. Let L C Jac(C)[2] he 
a maximal isotropic subgroup (with respect to the Weil pairing) then: 

• Lf g = 3 then there exists a curve G' such that Jac(C") = Jac(C)/L. 
The curve G' can be described algebraically in terms of the curve G 
and the maximal isotropic subgroup L. 

• If g > 3 then generically there is no curve C' such that Jac(C") = 
Jac(C)/L. 

1.7. The proof that Donagi and Livne presented for genus 3 is constructive 
in the set-theoretic sense. However, as a basis for explicit work it has draw- 
backs; it is not clear how to give coordinates to the spaces and functions 
involved or how one can track the canonical classes. 

The object of this paper is to extend Gauss's original work on curves 
of genus 1 to the case of genus 3. In Section [21 we use the Coble-Recillas 
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construction (reviewed in I2.9I2.1()|) to give an alternative construction to 
the one proposed in |DLj : we describe the curve C in terms of the pair 
{C,L), where the curve C is a generic curve. In Section |31 we describe the 
isomorphism between the canonical classes \Kc\ and |i^c'|- Section |3 
we derive the formulas describing the curve C in terms of the curve C and 
the isomorphism H^{C, Kc) — H^{C' , Kc)- We also show how to iterate 
the construction. In Section El we concentrate on real curves: assuming the 
curve C is a real M-curve (i.e. a real curve with 4 components) we present 
a distinguished maximal isotropic subgroup of Jac(C)[2], resulting in an 
iterative integration algorithm. 

Although our construction is stated over the complex numbers it is mostly 
algebraic. The complex structure is used in one crucial point: we use a result 
(due to Jordan in |Jorj section 332, or see Harris's modern approach in |Har j ) 
stating that the Galois group of the bitangents of a smooth plane quartic 
over the complex numbers is SPq{2). In the rest of the paper we require 
only that the characteristic of the base field is the one arising from using 
the bigonal and trigonal constructions; the characteristic of the base field K 
is not 2 or 3 (see the discussion in the introduction to [DLj). 

Some of the proofs in Sections I4I5I are computer aided proofs. The Math- 
ematica and MAGMA programs which generated the computer part of the 
proofs appears in |LRj . 

1.8. We remark that the AGM has a nice application in the area of curves 
over finite fields: Mestre observed that the theta-function identities involved 
in the AGM over p-adic fields can be used to study the number of points in 
curves over finite fields. See |Mesj . [LL] for results elliptic and hyperelliptic 
results and |Eitj for results on non hyperelliptic genus 3 curves. 

Acknowledgments. Section El and |31 of this paper were part of the first 
author's Ph.D. thesis, done under the advising of R. Livne, who suggested 
the series of questions above. I. Dolgachev kindly gave the first author an 
early copy of his preprint |Dol2j . and introduced him to the works of A. 
Coble. 

2. The construction 

2.1. The idea behind our construction is to filter the level-2 data and per- 
form the construction in three steps, using non principally polarized Abelian 
varieties to keep track of the level data. Throughout this paper we fix a 
generic curve C of genus 3, and a maximal isotropic fiag C = {{a) = Li 
L2 $i -^^3) with respect to the Weil pairing on Jac(C)[2]. Let C be a curve 
such that Jac(C") = Jac(C)/L3. The flag C induces a dual isotropic fiag 
C = {L[ C L2 C L3) in Jac(C")[2] in the following way: L[ (resp. Lg, 
resp. L3) is the image of (resp. Lj-, resp. Jac(C)[2]) under the map 
Jac(C) — > Jac{C)/ L3. We denote by a (respectively a') the non trivial ele- 
ment in Li (respectively L'^). Using the Coble- Recillas construction we will 
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introduce ramified double covers Y — > E and Y' — > E' such that there 
are natural isomorphisms 

Prym(y/^) ^ Jac(C)/L^, Y> ly ui{Y '/ E') ^ Jac(C")/i^i^. 

Using a bigonal construction (see |Donj p. 68-69 for an overview of the 
bigonal construction) we will prove that the polarized Abelian varieties 
Prym(y/is") and Prym(y/£') are dual to one another, up to finite data 
arising from L2. 

2.2. Before describing the geometry of the construction fin I2.1UII2.17() . we 
describe the finite symplectic algebra involved - the level-2 structure of the 
curve C. Define the following SPq{2) equivariant surjective map: 

D ■■ { ""lo^dcrcd pairs of distinct I , Jac(C)[2] \ {0} 

'-odd tneta criaractcristics 01 C J \ /l j l j 

{^1,^2}^ 01 -^2, 

(recall that the group SPq{2) acts on the odd theta characteristics via the 
monodromy action, see jHar j ) . Since the group SPq{2) acts transitively on 
the set Jac(C)[2] \ {0}, all the fibers of the map D are of the same order: 
(^2^) /63 = 6. For any 2-torsion point 7 in Jac(C) we define the Steiner 
system 

Since the pairs in a fiber of the map D do not intersect, the order of all 
the Steiner systems is 12. In Propositions 12.31 and 12.4] below we discuss the 
relation between the symplectic structure on the vector space Jac(C)[2] and 
the combinatorics of the 63 Steiner systems. 

2.3. Proposition. Let'j,^' be two distinct elements in Jac(C)[2]\{0}, then 
#(I1^ n Sy) is 4 if (7,7') = 0, and 6 otherwise. 

Proof. Since the group «S'P6(2) acts transitively on pairs of distinct elements 
in Jac(C) [2] \ {0} with the same Weil pairing, the order of the set n 
T,y depends only on the Weil pairing (7,7')- We denote the two possible 
intersection orders by no, ni. Any odd theta characteristic sits on 28— 1 = 27 
different S^s and the number of 7 G Jac(C)[2] \ {0, a} such that (7, a) = 
(resp. 1) is 30 (resp. 32). So we get 

12-27 = ^#{9 \ e e s„ns^} 

=#!;„ + #{a I (7, a) = 0}no + #{a | (7, a) = 0}ni 
=12 + 30?io + 32ni, 

and the unique non-negative integer solution of this equation is ni = 6, no = 
4. □ 



2.4. Proposition-Definition. The following properties hold: 
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• Let 7 be a 2-torsion point in Jac(C) then the map 

7-1 runordcred pairs of distinct -i t //-~iNrnl / 

■■ { classes in i ^ Jac(C)[2]/7 

{oj, aj} I— > Oj — Oj. 

is an isomorphism on (7^/7) \ {0}. Moreover, the map maps the inter- 
section pairing to the Weil pairing. 

• Let H be an isotropic subgroup of Jac(C)[2] of order 4, then there is 
an unique theta characteristic 9 such that for ah a G H, ^ + a is an odd 
theta characteristic. Denoting the set {9 + a,a £ H} by Th, one has 

• A maximal isotropic subgroup of Jac(C)[2] containing a is represented by 
a partition of T,a/a in three pairs. 

• If 7 Steiner systems intersect at 7 mutually distinct 4-tuples, then there 
is a maximal isotropic subgroup G C Jac(C)[2] such that these 7 Steiner 
systems are the Steiner systems of the non-zero elements of G. 

Proof. Let C SPq (2) be the stabilizer of 7, then the G^ orbits of Jac(C) [2] / 7 
are the sets 

{0},(7^/7)\{0},(Jac(C)[2]\7^)/7, 
which are of orders 1, 15, 16 respectively. Since the map is a non-trivial 
Gj equivariant map, and since the order of the set of unordered pairs of 
distinct points in is (2) = 15, the map D.y is a 1-1 map on the projective 
space (7^/7) \ {0}. By a similar counting argument we prove the claim on 
the Weil pairing. The last three assertions follow from Proposition 12.31 □ 

2.5. Using the description of one maximal isotropic flag in terms of odd 
theta characteristics we describe the combinatorics of two isotropic flags: 
C' = {{a') = L[ C L'2 C L'^) (see Ell and C = {{a) = Zi C Z2 C L3) in 
Jac(C")[2] such that: 

Lie4 = L'^, Z2©4 = L'^, ^304 = Jac(C')[2]. 

Such a description is essential for iterating the algorithm, as the pair (C', C) 
should be the starting point of the second iteration, playing the same role 
that the pair (C, C) played in the first iteration. Note that C is not uniquely 
defined. For further uses, we will need the following lemma: 

2.6. Lemma. For any subgroup H C L-^ of order 4 one has i^Tfj H Sq,/ = 
if H = L2 and j^Tn H Sq,' = 2 otherwise. 

Proof. Since we have L2 C L'l the Weil pairings of the non trivial elements 
in L2/L1, {L']^ ® Li)/Li are all 0. By Proposition 12.41 the intersection 

Dl\L2/U)r^Dl\[L',®L,)/L^) 

is empty. Whence, The intersection 
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is also empty. Reasoning in the same way, for any subgroup H G order 
4 such that H ^ £2 we have H is not a subset of L'^. By Proposition 12.41 

#{D^\H/L,) n Dt\{L[ e L^)/L^)) = 1 

and therefore the cardinaHty of the intersection Tj{ f] Sq,/ is 2. □ 

2.7. We now move to the geometric part of the construction. Recall that 
C is a generic genus 3 curve and that C = ((a) = ^ L2 C| L3) is a full 
isotropic flag in Jac(C)[2]. We start with the Coble- Recillas construction. 
Next we construct the double cover Y — > E mentioned above and review its 
properties. Finally we describe the AGM construction through the bigonal 
construction. 

2.8. Notations. If y — > [/ is a cover without specific name for the mor- 
phism, we denote the morphism by TTy/ij. In the following diagram we 
summarize some constructions and notations which will be introduced af- 
terwords. Note that this diagram admit a symmetry with respect to the ver- 
tical axis passing through the right term. These symmetric objects, which 
are related to (C",£') under those constructions, will be denoted with '. 



W 




C Z M 





Kc + a\* E 




pi 

The left construction is Coble-Recillas trigonal construction, and the right 
construction is (half of) a bigonal construction (see |Donj p. 68-69). 

2.9. Let us recall some elements of the theory of the trigonal construction 
(see for instance |Recj . [Doll j . |Leh] ) . Define 

W := C XiKc+a\*C\Ac = {{pi,P2) £CxC\pi+p2<Kc + a} 

(where by Ac we denote the diagonal). The curve W admits a natural 
involution - the coordinates switching which we denote by S. The curve 
Z = W/S can be viewed as the subset of Sym^(C) defined by {pi +p2 \ Pi + 
P2 < Kc + a} . The curve Z admits three natural non-trivial involutions : 

• <J : pi + p2 I— > P3 + P4 such that pi + P2 + Ps + P4 ~ Kc + a; denote 
X ■= Z/a. 

• i : pi +P2 I— > +P4: such that ps +^34 ~ pi +p2 + a; denote Y := Z/i. 



8 



D. LEHAVI AND C. RITZENTHALER 



• j = (J o i] denote F := Z/j. 

Remark. The curves Z has a "theta divisor interpretation" : the Abel map 
Sym^C — > Pic^C induces an isomorphism Z = Qc H (Oc + a) (see |Lehj 
3.1-3.4). In particular, Z is generically a smooth curve of genus 7. Note that 
the involution i is then d d + a, j is d Kq — d and o" is d i— > Kq + a — d. 

Let us denote by ip the morphism from Sym^(C) to \Kc\ defined by sending 
Pi +P2 to the line pTp2- As the supports of pi +P2 and j{pi +P2) as points 
on C C l-ft^cl* lie on the same line, ifj induces a morphism from F = Z/j to 
\Kc\ making the following diagram commutative: 

^ Sym2(C7) 

/j il> 

F^ ^\Kc\. 



It is classical that bitangents to C are in 1 — 1 correspondence with odd theta 
characteristics. Moreover if / is a bitangent corresponding to an element 
9 G Sq,, it defines a point on Z (still denoted 0): indeed, if ^ • C = 2{pi +P2) 
and \i 9 -\- a corresponds to a bitangent with divisor 2{p^ + P4) one gets 
{pi +P2) - [p-i +Pa) ~ a, so 

Pi + P2 + P3 + P4 ~ 2(pi + P2) + a ~ Kc + a. 

Thus P1+P2 < Kc + a. 

By definition of Z and j, the morphism j is ramified exactly at the 12 
elements of the Steiner system S^. As Z is of genus 7, F is of genus 1 and 
by the preceding embedding the 12 bitangents (viewed as points in 
are points on F. Note that F C \Kc\ is a cubic: the degree of the map 
F — > \Kc\ is 3 since deg(^/') = 6, and the map is non degenerate because 
the points of V'(Sa) are not colinear. 

As i is fixed point free and commutes with j, it defines a fixed point free 
involution ip on F exchanging the points 9,9 + a S S^. This involution 
defines a point aj? G Pic'^(F)[2] such that for all p G F, p + ap ~ ipip)- 
The quotient of F by the involution ip is the curve E = X/j (because 
{Z/a)/j = {Z/j)/i). Hence E is naturally embedded in \Kc\* by the image 
of TTp/p : p^ pn{p + ap). 

2.10. Theorem (Coble, see |Cobj sections 47-49 . (Lelij l. The images of the 
points of T,a C F under the map t^pje sit on a unique conic Q C |-fi^c|*- 
They are the intersection points of the bitangents 9,9 + a G S^. The locus 
Q f] E is the ramification locus of the map tty/e -Y^E. 

2.11 (The folloing results are mostly due to Coble and to Recillas). Let ap 
be the unique non zero element in {TTp/p)^(Fic{F)[2]) C Pic(E')[2]. Given 
the double cover Y — > E and the 2-torsion point ap one can reconstruct 
the curve C and the linear system \Kc + a| in the following way. We have 
F ~ E/ap. The curve Z is isomorphic to the fibered product Y Xp F. 
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This construction induces two commuting involutions i,j on Z. Since the 
double cover TTp/^ is unramified, the involutions i,j on Z are fixed points 
free. The genera of the curves Z, X, Y are then 7, 4, 4 respectively. The 
curve X is a bielliptic curve of genus 4 which has only one up to the 
bielliptic involution. Thus we are back in the trigonal construction setting. 
Note that C and the linear system |i('(7 + Q;| are invariant under the choice of 
the gl- On our way to (C, £'), we have now expressed (Jac(C), a) in terms 
of the double cover Z/X. The second step in the construction (see Theorem 
I2.15|) is to interpret the symplectic data through the quotient i. Our main 
tool for analysis of non principally polarized Abelian varieties are Lemmas 
12321 and EUSl below. 

2.12. Lemma (see |DLj . Lemma 1). Let V — > V be an admissible dou- 
ble cover, and let uV — > vV be its partial normalization at r > 1 points 
xi, . . . ,Xr G V. Let g be the arithmetic genus of the partial normalization 
vV , so the arithmetic genus of V is g + r. Then Frym(y /V) has a prin- 
cipal polarization, Prym(z/y/z>y) has a polarization of type 23V~^, and the 
pullback map 

V* : Frym{V/V) — > Frymii^V / uV) 
is an isogeny of degree 2^~^ . 

2.13. Lemma (the monodromy argument). Let V — > V be a finite cover 
such that the Galois group of the Galois closure of V /V is 2-transitive on 
the cover, then the only section of the cover V' XyV — > V is the diagonal. 

2.14. We will apply lemma 12.131 with the covers ^3 — > ^3 and A3 
where ^3 (resp. ^3^) is the moduli space of PPAV's dimension 3 with a 
2-torsion point (resp. with a maximal isotropic group). 

2.15. Theorem. The quotient by i induces an isogeny of Abelian varieties: 

(j) : Prym(Z/X) — > Frym{Y/E). 

Identifying the principally polarized Abelian varieties Jac(C) and Fvym{Z / X) 
as in |Donj Theorem 2.11 (p. 76), the kernel of cj) is . 

Proof. The proof consists of three steps: 

Step 1: The map (p : Prym(Z/X) — > Prym(y/£^) is an isogeny : 
To prove this claim it suffices to prove that the induced map on the tan- 
gent spaces at is an isomorphism. We do this by considering the space 
M := H^{Z, as a Gal(Z/i?) module, and calculating the module decom- 
position to irreducible representations. We denote by M_ the irreducible 
representation corresponding to the character whose kernel is the subgroup 
(— ) C Gsi\{Z/E), and by Mi the irreducible representation corresponding 
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to the trivial character. Using these notations we have: 

Mi®Mi®Mj®M^, H^{E,n]^) = Mi 
M( e M/' © Mj © M;j = Ml © Mj, 
Mi® Mi® M] ®Mi = Ml © Mi, 
Mf © Mf © M/ © M; = Ml © M„. 

However, since E and F are both of genus 1, the map H^{F^^^p) — > 
H^{E, fi^) is an isomorphism. Thus we have Mj = 0, and our claim holds. 
Step 2: The kernel of the isogeny (p is a subset of Prym(Z / X)[2]: 
Denoting by [2]„ the multiplication by 2 on an Abelian variety we have 

TTz/y^vr^/y : Jac(y) — > Jac{Y) = [2]jac(y). 

Denote by the restrictions of maps '^z/Y^,y'^*z/Y *° Abelian va- 

rieties Prym(y/£'), Prym(Z/X) respectively. Note that cp = ji* . We have 

= [2]pi.yin(Z/X)- 

Step 3: Computation of the kernel of (p: 

By applying Lemma 12.121 to some degeneration of the cover Y/ E along its 
ramification locus Q Ci E, on finds that the polarization type of the variety 
Prym(y/i?) is 2^1^. Thus, the order of the kernel of (p is 32. 
By jDonj Theorem 2.11 (p. 76) the norms in the trigonal construction 
induce an isomorphism Jac(C) = Prjm{Z/X). The kernel of (p is can thus 
be identified with /J-*- for some /? G Jac(C)[2]. The map (Jac(C),a) — > 
(Jac(C),/?) gives a endomorphism of ^3 and then a section from ^3 to 
^3 x_43 ^3. By Lemma |2 . 1 31 this section maps into the diagonal component 
so a = (3. □ 

2.16. Denote by gi, . . . , the intersection points of E and Q. In Proposition 
12. 41 we identified pairs of g^s with the non-zero points of the symplectic space 
a-^/a. This identification induces bijections between the following sets of 
data: 



data on isotropic subgroups in 
Jac(C)[2] that contain a. 


data on isotropic 
subgroups of a'^/a. 


partitions of the 
points {qi}i=i...6 


Iso. subgps of order 4 


Iso. subgps of order 2 


2 + 4 


Maximal iso. subgps 


Maximal iso. subgps. 


2 + 2 + 2 


Full isotropic flags 


Full isotropic flags 


2 + (2 + 2) 



We let {qi,q2},{{Q3iQ4},{Q5,Q6}} be the partition of the qiS that cor- 
responds to the full isotropic flag C. Denote by vr^j/pi the linear system 
1 9i + 92 1 on the curve E and by B the ramification locus of vr^; /pi . Note that 
the symmetric construction introduces a set B' . Using these definitions we 
are ready to prove the correctness of our construction: 
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2.17. Theorem. Let assume that the ramification pattern of the tower Y — > 
E — > is generic. Denote by H — > H — > the image of the tower 
Y — > E — > by the bigonal construction. Then the tower Y' — > E' — > 
P-*^ is the normalization of the tower H — > H — > P^ . Moreover, there is a 
1-1 correspondence between points b & Q H E \ {qi,q2} and points h' G B' , 
given by 

Proof. The ramification pattern of the bigonal construction on Y — > E — > 
P^ is the following (see |Donj p. 68-69): 

• If7r~Jpi(a) = {qi, 52}, then y/E' is ramified over both gi, ^2, TT^/piCo) 

is a node, and over this node the curve H is a gluing of two ramified 
sheets (symbolically : C C / = | DC / x ) . 

• If 7rgypi(a) = 26 for some 6 G i? then Y/E is etale over b, t^h/¥'^ is 

etale over a, and H is ramified over one of the points in 7r^J,pi(a) 
and ramified over the other one (symbolically : CC/c|C=/=). 

• If 7r~Jpi(a) 9 q for some q E Q D E \ {qi, 52} then Y/E is ramified 

over q, and etale over the other point in 7r~ypi(a). Moreover, tth/pi 

is ramified at a, and H/H is etale over both branches (symbolically 
: C=/=|CC/C). 

• In all other points the ramification patterns of the towers Y/E/F^ 
and H/H/F^ are generic (i.e. unramified). 

Denote by vH, uH the normalizations of the curves H, H respectively. By 
the Riemann-Horowitz formula, the genera of the curves vH, uH are 4, 1 
respectively. The ramification pattern over the points '7r£;/pi(q3), 7r£;/pi(g4), 
7r^/pi((75), 7r^/pi(g6) in the tower Y — > E — > P^ is C= / =. Thus, the 
partition {{93, §4}, {^5, ge}} induces a partition to two pairs of the 4 ramifi- 
cation points of the map vH — > P^, which induces a choice of a 2-torsion 
point in Y^\(P[vH). Applying the reconstruction technique from 12. ill to the 
double cover vH — > vH and the 2-torsion point we get a smooth curve C" 
of genus 3. We claim that we have the following degrees for the isogenics 

Jac(C) ^ Prym{H/H) ^ Frym{u H / 1^ H) ^ Jac{C"). 

By |Panj Proposition 3.1 (page 307) the Abelian variety PTym{H / H) is 
isomorphic to the dual of the Abelian variety Prym(y/ E) . Since PTym{Y/E) 
is isomorphic to Jac(C)/a"'", we have bv II .41 that Prym(if///) ~ Jac(C)/a. 
The second arrow is a consequence of Lemma 12.121 for the normalization of 
H/H over the point of type DC / x. The third arrow follow from Theorem 

1233 

Thus we have obtained an isogeny of degree 2"^. By our observation in ll.4[ 
this isogeny is given by a maximal isotropic group L G Jac(C)[2]. In the 
same spirit as in the proof of 12.151 we can use the monodromy argument of 
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Lemma l2.1l-il for L3 and L to prove that L = L^. Thus C" ~ C and we get 

i^H ~ Y', uH ~ E'. 

The ramification patterns prove the last assertion of the theorem. □ 

Remark. In the same way, one can describe analogous results for the other 
non-generic ramification patterns of the tower Y — > E — > P-^, but this 
effort is redundant: in Section |1] we will find a formula which gives C in 
terms of a generic pair {C,L); since C is continuous in the pair (C,L), the 
formula will be correct for all pairs (C, L) for which the denominators in the 
formula are non zero. 

3. The isomorphism between the canonical classes 

3.1. In this section we describe the isomorphism k : |i^c"|* — ^ l-^cl* be- 
tween the duals of the canonical classes of the curves C and C . In Section 
01 this description is used to calculate the equation of the canonical embed- 
ding of curve C" in terms of the canonical embedding of the curve C and to 
describe k : H^{Kc) H^{Kc'). 

We describe the isomorphism k by considering the images and preimages 
(under the map k) of the sets B,B' (recall the definition in I2.16|) and the 
points defined below: 

p ■■= EnqTq2\{qi,q2}, p' := E' n q'^q'^ \ {^^,92}- 
The resulting description is encoded in the following theorem: 

3.2. Theorem. The isomorphism k is completely determined by the follow- 
ing identities: 

k{Q'nE' ^{q[,q'^})=B, k(^^) =im 
k{B') = QnE\{qi,q2}, k{p') = p, 

where the identification of Q' D E' \ {q[, q2} with B, and of B' with QnE\ 
{qi^Q2} cLre the ones from Theorem \2.11\ 

Proof. The theorem follows from Theorem 13.61 and two applications of The- 
orem 1^31 below. □ 

3.3. To describe the isomorphism k we present it as a composition of three 
isomorphisms. Denote by jy (resp. Jy) the involution on the curve Y (resp. 
the homology group H^{Ky)) induced from the double cover Y — > E. 
Denote by H^{KY)odA (resp. i7''(Ky)even) the odd (resp. even) part of 
H^{Ky) with respect to the involution Jy. We denote by |i^y|odd (respec- 
tively |i^y|even) the projcctivization of the vector space H^{KY)odd (respec- 
tively H^{Ky) even)- We use the analog notations for subspaces of |/fy'|. 
The involution Jy induces an involution on the dual of the canonical system 
li^Tyj*. The fixed set under this involution is the union of the projective 
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plane |-ft'y|*dd ^^^d a point py, the projectivization of the space H^{KY)cvcn- 
By Theorem 12 . 1 71 we have a sequence of isogenies of Abehan varieties 

Jac(C) ^ Piym{Y/E) — > Fiym{Y'/E') Jac(C"). 

Taking the tangents spaces at of these varieties we get a sequence of 
isomorphisms: 

(1) H'{Kc) H\Ky)oM ^ H\Ky'Ua ^ H'iKc), 

Taking the dual, inverse and projectivizations of the spaces and morphisms 
in Equation we get another sequence of isomorphisms: 

I I * I 7>^ I * ^ \ I * ^ \ I * 

\Kc\ — > l-Ky|odd — ' l-Ky'lodd ' — l-^c'l • 

By construction, these two morphisms have interpretation in terms of the 
trigonal and bigonal constructions. With the notations of l2.9l the morphism 
<p is induced by t^w/y ^t^v/IC' ■'■^ same way, denoting by M the normal- 
ization of the Galois closure of the tower Y — > E — > , the isomorphism 
-0 is defined as the composition t^m/Y' ^ ° '^*M/y 

We discuss the morphism (j) in Theorem |S3] below. Our analysis is based on 
the two views of the set {qi}i=i..s presented in Theorem 12. 101 

• The qiS are in natural 1-1 correspondence with intersection points of 
pairs of bitangents, which lie in l-f^cl*- 

• The QiS are in natural 1-1 correspondence with the fixed points in Y 
of the involution jy, i.e. with the points of y n l-ft^ylodd ^ l-^i^l*- 

We interpret the relation between these views using the norms in the trig- 
onal construction. If TTyju : V — > U is one of the covers arising in our 
construction, we denote the ramification divisor of the map ttv/u by Rv/U- 
We will make repetitive use of the following version of the Riemann- Horowitz 
theorem (see |Harj Proposition IV. 2.1): Let uj be a differential on U then 
the zero divisor of the differential T^y/jjU) is 7ryyj^((w)o) -|- Ry/U- 

3.4. Theorem. The map (p : \Kc\* — > I -^i^ I odd ^^^^^ each of the qis to the 
corresponding point in YnlKyl*^^ C \Ky\* ■ Moreover, this property defines 
0. 

Proof. To avoid confusion between the points of W, Z, Y and divisors, we 
denote here a point of W by ipi,P2), on Z by {pi +P2) and a point of Y by 
{{Pi +P2), (P3 +P4)} if P3 +P4 = j{pi +P2) G Z. 

Let {pi+P2,P3+Pa} be the pair of theta characteristics in XiQ, which represent 
one of the qiS (see I2.16|) . Let to E H^{Kc) be a differential such that 
Wo = 2{pi+p2) then 

{'K*W/c{^))q - Rw/C = 7r^/c(^0) = 2((pi,P2) + {P2:PI) + X] ^i^Pj))- 

l<i<2 
3<i<4 
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So (vr^/t7(w)) > 2((pi,ji2) + (p2,Pi)) + Rw/C- By the properties of the 
trigonal construction (see |Donj p. 74) we have Rw/c ^ Rw/z- So we get 

(^VF/c(^) + S-Kw/C^^))^ ^ 2((pi,p2) + {P2,P1)) + 

The left summand is precisely the pull back of 7r^/^^7r^y(^(u;) so finally get 
Now 

So by invariance under Jy 

(^(tj))o = iTrw/Y^'^W/ci^))o > 2{(P1 +P2), (P3 +P4)}- 

As Qi is the intersection points of the two bitangents supported by {pi ,P2), (ps , Pa) , 
the last inequality implies 

HQi) = {{Pl +P2), {P3 +P4)}- 

Since the qiS are 6 non-collinear points this property completely describes 
the map 4>. □ 

3.5. It remains to analyze the isogeny tp induced from the bigonal construc- 
tion relating the double covers Y — > E and Y' — > E' (see the proof of 
Theorem 12 .171) . We make the identifications of Theorem 13.41 (so ip becomes 
k). As the linear system \p + qi + (?2| spans the space |-f^^r|odd (a-^id the same 
with the symmetric notation ') we reduce the description of the map to 
a description of a natural isomorphism between these linear systems on the 
curves E,E' . 

3.6. Theorem. The isomorphism ij) is determined by the following identi- 
ties: 

iPiQ'nE' ^{q[,q'^})=B, ^{q[q'^) =im 

iPiB')=QnE\{qi,q2}, Hp') = P, 
where the identification of Q' f] E' \ {q[, q'2} with B, and of B' with QCiE \ 
{^1,52} are the ones from theorem \2.17\ 

Proof. The theorem follows from the two claims below: 

(1) Let t be a point in and let a; be a differential in H^{KY)odd 
such that ^7ry/^^((u;)o) = p + 7r^ypi(t) then the image of uj under ■0 

satisfies i7ry,/£,^((^/'(u;))o) = p' + 7r^//pi (*) • 

(2) Let 6 be a point in the set B C E and let (7- be the corresponding 
point (in the sense of Theorem 12.17(1 in the set Q' n E' . Let a; be a 
differential in -ff''(i^Y)odd such that ny' /e' ^^{^)o ^ 26 then the image 
of Lo under ^p satisfies {ip{uj))o > 2q^. 

As in the proof of Theorem 13 . 41 we make repetitive use of Riemann-Horowitz 
theorem. 
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Proof of claim 1: Let lij be a differential as in the first claim above. Since 
the zero divisor of the differential uj is moving with t, the intersection 
(-TT^/y (a;))o n Rm/y is generically empty. By the definition of the bigonal 
construction 

(V'(a;))o ={'^M/Y'^T^*M/Yi^))o = ^^Af/y'^((^M/y('^))o - Rm/y) 
= 2'^M/y'^7r^/y(7ry/pi*(t) + TrY/E*ip))- 

Then 

^7ry//£;/^((V'(u;))o) = ^(■^M/E'^'^ll/piit) + T^M/E'^T^ll/EiP)) = ^£;/pi(*) +P- 

Proof of claim 2: Define the objects w, 6, as in the second claim above. 
By the definition of the point h we have (vr^^^y (u;))o > 7r*^^^pi(7rg/pi(6)). 
Whence: 

(V'(w))o ={t^m/y' ^M/Y^^))^ = 2^m/y\{{'^*m/y(^))o - Rm/Y') 

>2^^Vi^'*({* ^ ^M/pi(^£;/pi(&))l* Rm/Y'})- 

To prove the inequality {iI){uj))q > 2qi it suffices to show that Rm/y' ^ 
'^*M/Y'Ry /E' ~ ®' By bigonal construction dictionary (see Theorem 
I2.17() . if the cover Y — > is ramified over a point t then the cover E' — > P^ 
is etale over t. Since the curve M can be defined as the product £" Xpi y 
there are no multiple points in the ramification divisor R^ /pi . This proves 
that Rm/Y' n t^*miy'Ry' /E' = 0- Q 

4. A SMALL MATTER OF PROGRAMMING 

4.1. In the previous sections we presented an explicit construction of the 
AGM in genus 3. In this section we close the gap between "explicit" and 
a formula. We tackle five problems: describing the pair (C, a) 1)4. 314. 4|) . 
describing the intermediate data {E,Q),{E' ,Q') in term of (C, L2) (|4.5I - 
KWi . describing the pair (C",£') in terms of the pair (C,£) (I4.14H4.17I) . 
describing the isomorphism k : H'^{C,Kc) — > H^{C',Kc') (EUHl), and 
describing a flag C (see 1^3)) in terms of E',Q',C' ()4.19I4.21|) . We solve 
these problems by a "coordenification" of the proof of Theorem 13.21 We 
identify the two spaces li^cl* and under the isomorphism k. We 
denote the coordinates on this space by x, y, z (a precise choice of coordinate 
is described in l4.3|) . 

4.2. Notations. To write the equations, we use the lexicographic order on 
the dual coordinates of x, y, z. i.e. instead of writing ax'^ + bxy + cxz + 
dy"^ + eyz + fz"^, we will write {a,b,c,d,e,f). If we will talk about the 
corresponding curve, we will use the projective coordinates {a; b; c; d; e; f) . 
Finally, we will abuse the notations by using the name of a curve in for 
its defining equation. 
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4.3. The data (C, a). Let us consider the natural bilinear map 

H\Kc + a) X H^{Kc + a) ^ H\2Kc) = H\0\Kc\{'^)) 
((asi + 6S2)) (csi + ds2)) I— > acAi + (6c + ad)A-i + hdA2 

defined by the tensor multiplication of the sections Sj. Identifying \Kc + Oi\ 
with we also get a map 

TO : pi X ^ |2E:c|- 

We simplify the conies Ai by a special choice of our sections Sj: Let ^j, 0j+a S 
S„ for i = 1,2; we assume below that the pair {Oi^Oi + a) corresponds to 
the points qi by Theorem 12. lUI Note that the choice of a distinguished pair 
{51,52} is equivalent to the choice of L2 in Jac(C)[2] as described in 12.91 
Let In (resp. l2i) the bitangents corresponding to Oi (resp. 9i + a) and let 
be Dji the effective divisor of degree 2 such that 2Dji = (Zji)o, the we have 

Kc + a^ Dii + a{Dii) ^Du + io j{Dii) ~ + i{Dii) - + L»2i. 

We denote by Sj the sections of H^{Kc + a) corresponding to Dn + D2i. 
With this choice of sections, we have Ai = luhi and A2 = ^12^22- We now 
fix the coordinates {x;y;z) of \Kc\* such that Ai = {y — z){y + z) and 
A2 = {x — z){x + 2;). The following Proposition is now a particular case of 
a classical result (see |Dol2j l. 

4.4. Proposition. The quartic C is given by — A1A2 = 0. Assume that 
the quadrics j4i,^2 5^3 are respectively given by 

(0,0,0,1,0,-1), (1,0,0,0,0,-1), {a,b,c,d,e,f), 
then the coordinates of C £ lOi^^^i* (4)| are 

(a^; 2ab; 2ac; b^ + 2ad - 1; 26c + 2ae; 1 + c^ + 2a/; 26d; 2cd + 26e; 2ce + 26/; 
;2c/; d^- 2de- 1 + e^ + 2df; 2e/; f-l). 

In l4.5l4.T^ we will find the equations for the intermediate data (E, Q), (£", Q'). 

4.5. Theorem. Assume that the quadrics ^41,^42, ^3 are as in \4-4\ The 

coordinates of the curves E,E' G lOi^^^i* (3)| are 

E =(0; c; 6; e; 2{a + d + /); e; 0; 6; c; 0), 

E' =(-2ac; -2ae; 6^ - c^ - 4a/ - 1 - Aa^] 2cd; ib{d - a); 2be - Aac - 2c f 
;2de; 1 - 6^ + 4^^ + + 4d/; 2e{2d + /) - 26c; - c^). 
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The coordinates of the conies Q,Q' £ \0\Xc\*i'^)\ '^'"^ 
Q =(0; ce(62 - 1 + 4ad) - 2h{c^d + e^a) 

]h{-2hcd - e + b^e) + 2a{b^c + ce^ - 2bef) - Aa^be; 
■,b^c + 2c^de + 2b^{d - a)e - bc{l + Ad'^ + Adf) 
]c^e^ + b^{c^ + e^) - 2bce{a + d + /)), 
Q' =(-a(e2 - c^); 0; (d - a)(c(a + d + /) - 6e); ^(c^ - e^) 
;2(a - d){e{a + d + f) - be); {d - a){c^ - e^)). 

4.6. The essence of the proof is to convert the problem to a sequence of 
"steps" of the following form: find a pencil that is spanned by two known 
forms, and that contains another form we have to calculate. We perform 
these steps explicitly using a computer. Let us stress though, that in most 
cases two of the three forms involved in the computation are divisible by a 
known linear form. Thus, the obstinate reader could still check the compu- 
tations below, up to and including Theorem 14. 171 by hand. 

The curve E. Recall fsee 12. 9|) that to any point P1+P2 ^ Z one associate a 
point q £ E C \Kc\* as piP2 H psp^ where i{pi + P2) = Ps + Pi £ Z . Denote 
by A the conic given by the product of the lines pTp2 and P3P4. Note that 
the singular point of A is g. 

4.7. Lemma. There exists a unique couple of sections (up to permutation) 
{ti,t2) G H^{Kc + a)^ such that tit2 = A. Conversely, the singular point 
of each singular conic in ?n(P^ xf^)isonE. 

Proof. Let us show the first assertion. By definition of j, the zero divisor of 

^is 2Kc ~Pl+P2+j(Pl+P2)+P3+P4+i(P3+P4)- As Pz+Pa = i{pi+P2), 
one gets 

{A)o =pi+P2+ jo i{pi +P2) + i{pi +P2) + o i{pi +P2)- 

As pi+p2 + a-{pi+p2) G \Kc + a\ (resp. i{pi+P2) + o-°i{pi+P2) S \Kc + a\), 
the divisor defines a unique section ti (resp. t2) in H^{Kc + Q;). □ 

To account for the permutation of the two lines in Lemma 14.71 we intro- 
duce the map 

V2: X ^ p2 ~ Sym¥^ 

(A,/i), (A',/x') ^ {XX',fi^i',\fi' + ij,X'). 

Let (X; Y] Z) be the coordinates in f2(P^ x P^). Lemma [4.71 can be reformu- 
lated into : the curve E can be seen as the locus {x; y; z) of singular points 
in the net of conies XAi + YA2 + ZA3. If M = XqAi + 10^2 + ZqA^ is such 
a conic, it is singular at go if ^-nd only if 

0\ I MM\ I {A^)y{qQ) {Ai)MY / Xo\ 

= Myiqo) = iA2Uqo) {A2)y{q^) (^2).(<?o) h 
j \ MM J \ (AsUqo) {A3)yiqo) {A3)M J \ Zo J 
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Denote by Jac{Ai, A2, A3) the previous matrix. Thus the curve E is given 
by det(Jac(^i,^2,^3)) = 0. 

The curve Q. It is easy to check algebraically that the point o := (0;0; 1) 
lies on E (see 14.151 for a geometric explanation). Let qi := ogin E \ {o, qi} 
and q2 := oq2 Pi E \ {o, 52}- Let 

Q .= Nulls(4^^ _ 

dx dy dy dx 



4.8. Proposition. The cubics E, Qqiq2, Qqiq2 on the same pencil. More- 
over p G qiq2- 




Proof. Recall that the intersection points qi Q Ci E are the intersection 
points of the pairs of bitangents 9i, 9i+a. With the notations of the previous 
proof, if pi + P2 is the divisor associated to 9i, the divisor associated to the 
product of the two lines is 2{pi+p2)+2i{pi+p2). So ti = t2 and the points qi 
correspond to singular points of singular conies of the form m((A; /i), (A; fi)) 
i.e. 

QnE = {{x;y;z) \ 3ac{Ai, A2, A^f ■ (A^;U^2A^)* = for one (A;^f) G P^}. 

Since = = the points oi Q Ci E are the (x; y; z) coordinates for 
which the following system admits a solution 

^^pt + 2^— A^ = 0, — — A^ + 2— — A^ = 
ox ox Oy oy 

dA] , r, dAo n dA'i , , . s , , s 

— ^A^ + — ^/i^ ^ 2— ^A/i = 0, A,/i/0,0. 

oz Oz Oz 

If A = (resp. /i = 0) this system admits qi (resp. 52) as a solution. If 
Xf-L 7^ then a solution satisfies 



THE GENUS 3 AGM 



19 



SO it belongs to Q. Hence the intersection points of Q and Q are E ■ Q \ 
{91,92} = 5' (see El. 

It follows from the definition of qi that qi £ Q for i = 1,2. We compute the 
intersections: 

E ■ {OMi) > {B' + qi + 92) + qi + 92 

and 

E ■ {Qqm) > {B' + 91 + 9''2) + (91 + 92 + p). 
These 3 cubics have thus 8 points in common so they lie in the same pencil. 
Moreover their last intersection point is the same too, so p G 91 92- D 

4.9. The curve E' . For the purpose of describing the isotropic subgroup L3, 
as well as for technical reasons we set the following notations: Denote by 
Qp the unique conic such that Qp - E = 2p + B, and by Q'^ the unique conic 
such that Q'p ■ E' = 2p + B' (the notations B,B',p were defined in 12. 161 and 
13.11) . Recall that under the identification of the linear system give by k, we 
have EnQnQ'p = B' and E' nQ' nQp = B. 

4.10. Proposition. The plane cubics E, QTp{E) , qiq2Qp lie on the same 
pencil. 




Tp{E) 



Proof. As in the previous proof, this follows after calculating the intersec- 
tions: 

E-iQ + Tp{E)) > {B' + qi + q2) + 2p, E-{imQ'p) > {qi+q2+p) + {B' + p). 

□ 

4.11. Let J = Uh(zB'pb ; we compute the quartic defining J using the follow- 
ing procedure. 

(1) Since p = (— e; c; 0), the lines passing through p are given by linear 
forms cx + ey — az = for some a € C. Thus J = 11^=1 (ex + ey — ) , 
where the a^'s are defined by the property cxi + eyi = ai for each of 
the four points (x^; yi] 1) G B' . 
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(2) let Y = cx + ey, then Yi := cxi + eyi are the roots of the polynomial 
R(Y) = {ResultantiQ{x,{Y - cx)/e,l),Q'p{x,Y - cx)/e,l),x). So 
by definition, in affine coordinates, J = R{cx + ey). 

4.12. Proposition. The plane quartics E'Tp{Qp),Qp'^ , J lie on the same 
pencil. 




Proof. By the definition of J, Q'p we have: 

• J = 2{B' + 4p), • {E' + Tp{Q'^)) = 2{{B' + 2p) + 2p). 

So the three quartics belongs to the same pencil. □ 

4.13. The curve Q' . We compute Q' using Proposition 14. lOl and symmetry. 
To compute the conic Qp, one notes that Qp ■ E = 2p + B. By definition of 
B in lTTHl b e B M and only if Tb{E) ■ E = 2b + p. It is then classical (see 
for instance Salmon |Salj ) that Qp is the polar conic of p with respect to E 
- recall that \i p = (xq; yo',zo) S E then the polar conic of p with respect to 
E is given by the equation xqEx + y^Ey + zqEz = 0. 

4.14. To complete the calculation of (C, C) from (C, £) we still have to make 
a final choice - the partition of the set B' to the two pairs {{93, 94}, {(75, ge}}- 
Geometrically, this is the choice of the singular conic q^QA U QMq among the 
three singular conies in the pencil spanned by the conies Q, Q'p. We start 
with a lemma on the symmetric situation: 

4.15. Lemma. The following equality holds: 

Q3Q4 =P + aE = 0, 

where the addition is in Pic(£^). 

Proof. To see the first equality, note that 2q'--\-p is a line section of ii^ C |-f^cl* 
for alH = 3, . . . , 6. By the proof of Theorem 12. 17( and the symmetry on the 
construction, we also have q'^ — qi = q^ — q'q = cue- Setting := p + oe we 
see that qs + q^ + o = 2^3 +p and ^5 + ^6 + = 2^5 +p are both line sections. 
To see the second equality, note that TpECiToE lies on E, which means that 
7 := p — o is in Pic(£')[2]. However, by a monodromy argument on maximal 
isototropic flags on Jac(C)[2] containing L2, we have 7 = ue- □ 
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4.16. In order to find an equation for (C",a') in tlie form A'^ = A[A2, we 
apply projective transformation to mimic the form of the couple {E,Q). 
Denote by T a projective transformation of |i^c|* that sends qi,q2 and 
QsQl ^QbOE the points (1; 0; 0), (0; 1; 0) and (0;0;1) respectively. Denote 
T{E') = (ei, . . . , do) and T{Q') = (di, . . . , dg)- Finally define T2 to be the 
transformation which operates by a multiplication of the x-axis by \/ 62/69, 
and a multiplication of the y-axis by \fe^Je^. 

4.17. Theorem. The coordinates of the quadrics forms T(A'-^^),T{A2) are 
given by 

(0, 0, 0, 64/66, 0, -1) (62/69, 0, 0, 0, 0,-1), 
while the coordinates of the quadric form T{A'^) are given by 

(6266(62fi3 " 63^2), 2626364^6, 26^66^6, 64(6266^5 - 6369^2) 
, 2626466^6, -66(-6265(i6 + 6266^5 + 6269^3 - 26369^2) 

/ 46669 (666265d663'^2 + elc^d^d^ - 6^6263^2^5 " 696662^363^^2 

Y +egeeeldl - eeelesd^de - eleld2de + e2ele4dl - 62 63 64 66^3 4) 

Proof. Let us assume that we have taken A'^ (resp. A2) such that T2oT{A'-^) 
(resp. T2 o T{A[)) is the conic - (resp. - z^). Let T2 o T{A'^) = 
{a',b',c',d',e'J'). By Theorem 1131 if we call (^2,^2) the data {E,Q) 
associated to these transformations of A'^, A2, A'^, we have 

E2 = (0; c'; b'; 0; e'; 2{a' + d' + /'); e'; 0; b'; c'; 0), 

Q2 = (0; c'e'{b'^ - 1 + 4a'd') - 2b'{c'^d' + e'^a'); 

b'{-2b'c'd' -e' + b'^e') + 2a'(6''c' + c'e'' - 26'e7') - 4.a'h'e'; 0; 
+ 2c'^d'e' + 2b'\d' - ay - b'c'{l + M''^ + Ad'f); 

c'2e'2 ^ ^/2^^,2 ^ ^,2^ _ 2b'c'e'{a' + d' + /')). 

IfweletT2or(£:') = (0,c,6,e,5,e,0,6,c,0) andr2or(Q') = (0, <52, 0, ^3, ^4) 
there exists a constant ^ such that 

b' = b/C, c' = c/t e' = e/e, a' + + /' = g/(20 

and 

-25c2 -2be^ I ^'^ 

-262c 262c + 2ce2 - 2beg be a'^ 

2pe + 2c?e - 2bcg -2Pe be J \ ^a'd'e - ^ 

By the geometry of the configuration and the coordinates we chose, the only 
solutions a',d\^ to the system above arise from solutions of the quadric 
T2 o T{A'^). Since the quadric A'^ is determined up to a sign, the matrix 
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equation above has only one solution, and this solution determines a',d',(, 
up to a choice of a sign. We apply then the transformation Tg"^ to find the 
expression of TlA^) in terms of ei,di. □ 

Remark. Note that the transformation T2, and the square roots 62/69, 
64/66 served merely as technical aids in the proof above, and indeed van- 
ished in the final result. The situation is different with the root we take to 
distinguish between q'i,q2- Recall that when performing the trigonal con- 
struction, one has to take a degree 2 field extension in order to construct W' 
from the tower Z' /X' /F^, and one has to construct W' in order to construct 
C. Since after distinguishing between q'i,q'2 we can construct C, the root 
we take when we distinguish between these points generate the field exten- 
sion of the function field of W' over the function field of Z'. This carries 
little significance when working over an algebraically closed field, but when 
working over a non-algebraically closed field, it reflects the fact that in order 
to find the isogeny Piym{Z / X) = Jac(C) we may have to make a degree 2 
field extension of the base field. 

4.18. Corollary. Let A4 be the moduli of a, b, c, d, e, f and a root of the cubic 
form (in t) Hessian(tQp -|- Q), then: 

• The space M is birational to a finite cover of the moduli of C, C with 
monodromy group naturally isomorphic to D^. 

• The map T2 o T is defined globally over Ai. Moreover as a map 
on quadrics in x,y,z with parameters in A4, the map T2 o T is an 
involution that lifts the involution {C,C) — > {C',C'). 

• Using affine coordinates on \ Kq \ * (by setting z = 1) the map k is 
given by the formula 

(Idx \ 1 / Idx 

d{A[A', - A',')/dy j ^ [d{A,A2-Al)/dy 

where I is any linear form. 

Proof. The first assertion follows from the choice of coordinates we use (see 
Theorem 14. 5|) . and the fact that the singular conies in the pencil of con- 
ies spanned by Q'p, Q are in 1-1 correspondence with the roots of the cubic 
Hessian(tQp + Q). The dihedral group is the symmetry group acting on the 
nested partition of linear forms {{x — z,x + z},{y — z,y + z}}. 
The second assertion follows from the definition of T and T2 , and from The- 
orem 

It is well known that a basis of regular differentials on a genus 3 non hy- 

perelliptic curve C can be given by ^ Q(c)/Qy ^ • With the identifications we 

have made during the construction on the coordinates {x;y; z), {x' 'jy'; z') 
(see 14. 1() , the map k with this choice of bases is given by the transformation 
(T2 o T)~^ up to a constant. However, since r2 o T is an involution on Ai, 
the square of this constant is 1. □ 



THE GENUS 3 AGM 



23 



4.19. Our final objective in this section is to show how one iterates the 
construction. Followiner 12.51 we denote with the objects related to (C",£). 
Our first task is to find an a. By our analysis of the symplectic pairings in 
Proposition 12.41 and in 12.161 we have 

#D-/(d)n{<7^,(?a = i ^ «^4- 

So we can assume that Z)~/(d) = {(/3, ^5}. The situation can be represented 
as follows : 




Thus, the four bitangents l3'^i,P's2 (ly™g O'^sr q'^) P'^i,P'k,2 (lying over g^) 
in Tai^a = ^a' H (Proposition 1231) can be grouped as {P3i,(3'^2) ^^'^ 
{f^'^i, (^32) to give a possible a (the other grouping correspond to an a + a'). 
Let us denote = P'^i H f3'^2 ^^'^ ^5 = P'bi ^ ^'32- ^1 Q cubic and 

conic associated to (C, a). We denote = Q r\ E. 

The second step is to find L2. By Proposition 12.41 a maximal isotropic 
group which contains a' (resp. d) is equivalent to the partition of S^'/a' 
(resp. Sa/d) in three pairs. There are three different maximal isotropic 
spaces containing a'©d, given by the non-zero points in {a' ® a)-^ / {a' ® a) . 
These maximal flags are in bijection with partitions two pairs of the points 
92' ^4' ^ei' ^is° with partition to pairs of the points {qi-,q2AiA&}- 
One of the three maximal isotropic groups containing d © a' is d © -L2 , the 
two others corresponds to a' © L2 for the two different choices of L2. Thus, 
in order to choose L2 we first choose the maximal isotropic group a' © L2, 
and in making this choice, we exclude the partition corresponding to the 
group d © L2 • 

The partition of {q'l, q'2, q'4^, q'o) which correspond to a' © L2 is simply the 
partition {<?!, {^4' '/ei' ™ order to proceed we will have to find the 
corresponding partition of {qi, g2> ?4> ^e}- To do this we will describe explic- 
itly the natural isomorphism between the three partitions to two pairs of 
these 4-tuples. This isomorphism is geometric in nature, and to describe it 
we will interpret these partitions as singular conies defined by the partitions 
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To describe the isomorphism we need some more notations : if 01,02 G 
Jac(C")[2] such that (01,02) = 0, one denote by ^3^^-, £"0,-, Q^. ,p(oi) the 
elements A3, E, Q,p relative to the construction starting from (C", Oj). Also 
we denote by Ea^i^aj and Qp(ai),a the curve E' and the conic Qp constructed 
from the data (C, Oj C OjSoj) and by ' the symmetric constructions. Note 
that 

for any maximal isotropic group L containing OjSoj. However, Qp(ai),aj / 

Qp{aj),ai ■ 

4.20. Lemma. The identification of a singular conic through {g^, ^4) ^ei 
(resp. {qi,q2, QijQe}) with a root of 

Hessian{Qa' + uQp{a'),a) (resp. Hessian{Qa + uQp(^a),a')) 

defines a natural transformation : ^ which fixes 00 and maps the 
two triple of roots bijectively. 

Proof. We have Ea'^a = Ea@a'- Let t be the translation on E^^a' by 
p{a) -p{a'). Let SQ^j,,) SQ„, (resp. SQ^j^).." *Qa) denote the sections of 
the bundle of i?Q,'©a defined by the divisor '?i + 92 + 94 + 96 (resp. qi, q2, Qi, qe) 
and corresponding to the subscript objects. Since Qp(^a').a (resp. Qp(^a),a') 
is the polar conic of p(o') (resp. p{a)), there exists a £ K such that 

Thus t maps the points {<?!, 94' ^ei orito {qi,q2, Q4>Q6}- Since t*{sQ^,) 
contains the points {qi,q2,q4,q6}i there are also two constants 6, c such 
that t*{sQ^,) = bsQ^ + csq^^^^^,. Thus any section in the pencil sq^, + 
'^^Qp(ai) a through t on bsQ-+{au+c)sQ^^^^ ^, . Hence there is an affine 

transformation /x which maps a conic Qa' + uQp{a'),a to Qa' + IJ'iu)Qp{a),a' ■ 
In particular, a singular conic is mapped to a singular conic which means 
that fi maps the three roots of Hessian(<5Q,/ + uQp(^^iy^) to the three roots 
of Hessian((5a + uQp(^a),a')- 

To identify the transformation /i, we work on the generic case C given by 
(a', 6', c', d', e', /') and we are looking for a continuous affine transformation. 
We assume that the bitangents P'^^ , I3'j^2 ■> (^51 1 P52 are y — z,y + z,x — z,x + z 
respectively. Denote by 

T:=i( 1 -I 2 ) 

the transformation which sends y—z, y+z, x—z, x+z to y—z, x+z, x—z, y+z 
respectively. This projective transformation defines a linear transformation 



THE GENUS 3 AGM 25 

Ta on the coefficients of A^^^' given by {a' ,b' ,c' , d' ,e' , f) maps to the coef- 
ficients of A^^a 

i^ia' -b'-c' + d' + e' + /'), ^i-a' + h' -d' + f), i(-2a' + c' + 2d' + e'), 

^(a' - 6' + c' + - e' - /'), ^{2a' + c' - 2d' + e'), a' + b' + d') 

Using Theorem 14.51 we can compute the different objects involved and we 
find 

li{u) ={2a' -c - 2d' - e) ■ {2a' + c - 2d' + e) 

• (2a'6'e'^ - Aa'c'd'e' - b'^c'e' + 2b'c'^d' + c'e')u 
+ 2e' ■ c' ■ a'- 

• {4a'%' - Sa'b'd' - 2a'c'e' - b'c'^ + 4b' d'^ - be'^ - 2c'd'e' + 2c'e'f'). 

Let us say a few words about the computation: we are comparing the co- 
efficients of two monic cubic forms in n, under the transformation u i— > 
{fiQU + Hi)- Thus we get the equation: 

e{u^ + a2U^ + aiu + oq) = (/Uqu + fii)^ + 62(^0'" + ^1)^ + bi{^LQU + /ii) + 6o- 
Comparing the u coefficients we get a system of equations in 

3/^1 + 62 - /ioa2 = 0, 

< 3//f + 262/Ui + bi- ulai = 0, 

^^f + 62^1 + + &0 - MoOo =0. 

We solve the system by finding the two solutions of the first two equations, 
and checking which of the two solutions solves the third equation. □ 

4.21. By a projective transformation one can send the bitangents fi'^n, (^'■^2^ 
P'^i, P'52 to y — z,y + z,x — z,x + z respectively. Using the previous lemma, 
one can then identify the value uq of u corresponding to d + L2 (i.e to the 
singular conic whose one component is q'iq'2) and then exclude the singular 
conic Qa + fJ-{uo)Qp(^a),a' ■ Let us denote this one qiq2 U q4% and then L2 is 
represented for instance by q^qe- 

The last task is to identify L3 : by Lemma 12.61 it has to contain one of the 
points 93, % so it is given by any of the choice of a pair {^2, %} or {q2, qs}- 

5. Real curves 

5.1. In this section we show that if C is a real M curve of genus 3 (i.e. a 
curve with 4 components), then the topology of the real structure induces a 
distinguished isotropic flag Li C L3 in Jac(C)[2] such that the curve C is 
an M curve. In Theorem 15.31 we establish a bijection between partitions of 
the four components of the curve C to two pairs, and the set of full flags £ 
containing the flag Li C L3. In 15.51 we show how to find the topologically 
distinguished flag C on the curve C using the data C',C' (one calculates 
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C", a from the pair C, £) by taking square roots as described in 14.191 - thus 
getting an iterative process - we will show that the choice of these square 
roots is uniquely determined by the topology. Finally, in 15. 81 we describe the 
iterative integration algorithm. 

5.2. Let C be a real plane quartic with 4 components Ci,C2,C3,C4. We 
denote by Jac]R(C) the real part of the Jacobian of the curve C, and by 
JaC]R(C)o the 0-component of JaciR(C) - see ICxHj p. 159. Recall that since 
the degree of the curve C is even, each of the CjS is null homotopic in PR^ (see 
e.g. |GHj ) . Whence, the set MP^xCj is a union of a disk and a Mobius strip. 
Recall also that the quotient Jac]8(C)[2]/Jac]8(C)o[2] is naturally isomorphic 
to the vector space F2[Ci, C2, C3, C4]/F2, where F2 acts by adding Ipj to all 
the coordinates. 

Let {{Ci, C3}, {C2, C4}} be a partition of the four components to two 
pairs. Denote by q a point in the trivial component of PM^ \ Cj, and choose 
the infinity line /qo in FIR^ such that the 4 points ci , C2 , C3 , C4 admit a cyclic 
order in PM^ \ /qo (formally, this means that ci , C2 , C3 , C4 sit on an ellipse in 
PM^ \ Zoo in the order 1, 2, 3, 4). We assume the order induced on ci, C2, C3, C4 
from the choice of the line I^q is counter clock wise. Note that there is a 
natural isomorphism 



n:=Hi (PM^ \ {ci , C2 , C3 , C4} , F2) = F2 [Zoo] e F2 [Ci , C2 , C3 , /F2 . 



Since the bitangents are lines, the classes of the bitangents in H, have non 
trivial Zoo coordinate; in fact a much stronger result holds: 

5.3. Theorem. For any i £ {1,...,4} there is a Steiner system Sj such 
that the bitangents in Sj have exactly four representatives in each of the 
following homology classes in 7i: 



Zoo ~l" Ci, Zoo ~l" Ci + Ci^i (mod 4)) ^oo ~l~ C'i— 1 (mod 4)- 

Proof. All additions of indices in the proof are modulo 4. For any i < j 
consider a one parameter degeneration of the curve C to a curve Cij such 
that on dj, the ovals Ci,Ci-i are connected with a node, and the ovals 
Cj, Cj-i are connected with a node - see the figure below. 
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By |Bealj the degeneration of each of the two nodes degenerates a 2-torsion 
point in the Jacobian variety Jac(C); we mark these points by 7j,7j. Under 
the degeneration from C to Cij , any of the 6 pairs of bitangents in the Steiner 
system S^. degenerates to one double hne through the node of corresponding 
to 7j; the same property holds also for j. Moreover the intersection of the 
Steiner systems D T,^. is then the quadrapole line through the two nodes 
of Cij. Thus by Proposition 12.41 the Weil pairing {jij^j) is 0, and all the 
bitangents in have the same homology class in 7i: If j = i + 1 this 

class is Iqo + Ci, and if j = i + 2 this class is /oo + Cj + Q+i- D 

5.4. In Theorem 15.31 we identified the homology classes of 24 bitangents. 
Since for any i there is a bitangent to Cj,Ci+i in the class ?oo, this com- 
pletes the identification of the bitangents. By Proposition 12.41 we have also 
identified a distinguished flag given by the following partition data: 

• Four bitangents in the class of loo- 

• Four bitangents in each of the classes /oo , ^oo + C*! + C's > ^oo + ^^2 + ^^4 - 
by the combinatorial structure we described and by Proposition 12.41 
this is a Steiner system. 

• Four bitangents in each of the classes in 7i with non trivial line 
coordinate except the class loo + Ci + C3. 

Finally recall (see |Huij ) that since C is an M curve, the variety Jac]R(C)o is 
naturally isomorphic to a product of any 3(= genus (C)) of the components. 
Since the group JaciR(C)o[2] is spanned by any two subgroups of order 4 in 
it, and since four of the order 4 subgroups we built above sit in the product 
of 3 components of the curve, the maximal group in the flag we built is 
JacK(C)o[2]. Note that the quotient JaciR(C)/L3 is the Jacobian of an M 
curve if and only if this quotient has 2^ components, which means that 
L3 = JacK(C)o[2] - thus the choice of a distinguished L3 we made above is 
indeed the unique choice which will enable iteration. 
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5.5. To complete the description of an iterative algorithm we have to solve 
two problems: initiating the algorithm, and performing an iterative step. In 
the discussion of these problems we will apply several times the proposition 
below. 

5.6. Proposition. The symplecto- algebraic properties of a configuration of 
bitangents to a real M- curve of genus 3, as points on the odd part of an affine 
symplectic space, are determined by the homotopy classes of the bitangents 
in P]R2 \ 

{cj}^^2 ^'^'^ intersection pattern of the bitangents with the 
components of C . 

Proof. This follows from the following facts: 

• Bitangents are continuous on families. Thus, the homology classes 
of bitangents in MP2 \ 

{ci}\ is constant on families. 

• Level structure is continuous on families. 

• The moduli space of M-curves is irreducible. 

□ 

5.7. We will apply Proposition 15.61 several times to study the configuration 
of bitangents arising from 14.1^ We will describe real algebro-geometric data 
on the moduli of configurations of bitangents that defines several non-zero 
real algebraic functions. To show that some real configuration is associated 
with a distinguished flag (in the sense of Theorem 15.3(1 we will present one 
curve for which our function is positive on the distinguished configuration 
and negative on the others. The conceptual calculations appear below. The 
related numeric calculations are in |LRj . 

Initiating the algorithm. To initiate the algorithm one essentially has to 
solve, in a Galois theory sense, the bitangents of the curve C. As the Ga- 
lois group acting on the bitangents is generically unsolvable, this problem is 
generically unsolvable in radicals. However, there are still other computa- 
tionally useful problems we will answer: 

• Determine if on a given M-curve of genus 3 and quadrics Ai, A2, A^, the 
flag Li C L2 induced from Ai,A2, A^ is a subflag of a distinguished flag (in 
the sense of Theorem 15. 3|) . To check this it suffices to verify that the curve 
C lies in one component of PM^ \ Nulls(^iA2)- It suffices to check this on 
an infinitesimal neighborhood of the 4 bitangents determined by the conies 

^1,^2- 

• Given an M-curve C in the form A1A2 — A'^ such that the induced flag 
is a subflag of a distinguished flag, mark the choice of the distinguished 
group L3. Note that the quartic form (x^ — z^){y'^ — z^) separate the real 
projective plane to 3 positive components and 4 negative components. Thus, 
if the form A3, calculated as in 14. 171 is purely imaginary, then the curve C is 
an M curve, and thus the choice of L3 is the distinguished choice. Note also 
that is purely imaginary if and only if the expression under the square 
root in Theorem 14. 171 is negative. By Proposition 15. 6| it suffice to show one 
example of a curve C with purely imaginary A3 . We do this in |LB,j . 
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Describing the iterative step: Recall (see 14.191) that during the calculation of 
the iterative step in l4.19( the field extensions where geometrically described 
by making several times choices of the following type: given three lines 
li, hih and two pairs of points Pii,Pi2 S \ {k n {h-i U l^)) find a partition 
to two pairs of the four points pn,Pi2,P2i,P22 that is not the one arising 
from the lines /i,/2- This choice boils down to a positivity question: we 
consider the pencil of conies throughput the four points Pii,Pi2,P2i,P22- 
There are three singular conies in this pencil, one of which is given by liUl2- 
Moreover, li U I2 cuts to two components, and the two nodes of the two 
other singular conies in the pencil, which are pTTp2i U P22P12, P11P22 U P12P21 
appear one in each of the two components of PM^ \ (/i U/2)- We calculate the 
choices which bring us to a distinguished on C (in the sense of Theorem 15 .31 
in |LRj ) . We plot in the figure below one step of the computation - finding 
the distinguished topological configuration of ^^/^i^ (See I4.1S)|) . The set 
r^,^ is plotted in dashed red lines and the set T^^^q/,' is plotted in blue 
dotted lines. 




5.8. We conclude this section with a description of the integration algorithm. 
By |Huij the component of the real Jacobian of the curve C is a product of 
any 3 of the components of C. Thus, real projective cycles on the Jacobian 
of C are homologous to sums of CjS. By the same argument, these sums 
map under our construction to sums of the components of C. Considering 
the theta function of C we see that when the AGM algorithm is applied 
iteratively, the distances between the bitangents in each of the distinguished 
4-tuples are decreasing exponentially, i.e., the limit curve of this process is 
a union of 4 lines in PR^. Using this method and Corollarv 14. 181 we reduced 
the calculation of integrals of cycles on JacK(C) to calculation of integrals 
of rational functions on line segments. 

In the figure below, which is computed in the final step of |LE,j . we plot 
two iterations of our algorithm, where the canonical classes of the curves 
C, C, and the next curve in the iterative process are identified. 
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